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In July 1985, 16 local school units began 
participating in the North Carolina Career Development Program Pilot. 
This report provides information about activities in the pilot 
program during the school year 19B6-87. During that period, the 
following major activities occurred: (1) 42 percent of the 
participating employees earned Career Status II; (2) a state-wide 
appeals procedure was developed and implemented; and (3) a plan for 
program self -study was developed. An analysis of the data indicated 
that evaluators within units rated teachers consistently during 
1987-88. There were differences, however, in the ratings of teachers 
across units, indicating that a common understanding of the rating 
criteria did not exist across the state. The data also show that 
evaluators within 13 units changed their ratings as they became more 
experienced, with some lowering their ratings while others raised 
them. A summary of the progress of the units in moving toward the 
goal of implementing a valid and reliable evaluation is presented. 
The equity of the system is also d^ ^cussed. Data from the study are 
presented in seven tables. (JD) 
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EXECUTIVE SUMMARY 



During school year 1986-87, the sixteen local school units participating in the Career 
Development Program concentrated on three major activities: 

1 ) Awarding of Career Status II. An average of forty-two percent of participating 
employees In the 1 5 units were awarded Career Status II, based on both experience 
and performance ratings. (This represents about 82 percent of thcce who applied for 
the higher status). If only performance ratings by evaluators were to be considered, 
It appears that 67 percent of all employees could be awarded Career Status II. 

The data show that evaluators within units rated teachers consistently during 
1987-88. However, there were differences in the ratings of teachers across 
units, meaning that a common understanding of the rating criteria does not exist 
across the state. The data also show that evaluators within 13 units changed their 
ratings as they becanfie more exioerienced, with some lowering their ratings 
while others raised their ratings. 

2) Appeals process. An appeals process was developed and implemented. aatotalof62 
Career Status 11 appeals (representing 1 percent of all participants), the panel 
upheld the principal's decision in 49 cases, while in 10 the panel upheld the 
appellant. All three Career Status I appeals upheld the principal's dedsion. 

3) Self study. Long-term program goals and short-term implementation goals taken 
from the legislation have been developed. Units have used these goals for self-study, 
and data are currently being compiled within each unit. 
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CAREER DEVELOPMENT: A REPORT TO THE LEGISLATURE 



In July 1985, sixteen local school units began participating in the North 
Carolina Career Development Program pilot. Progress during the 1985-86 has 
previously been reported to the General Assembly. This report will provide 
information about activities in the pilot program during school year 1986-87. 
During that period, the following major activities occurred: 

• 42 percent of participating employees earned Career Status II. 

f A state-wide appeals procedure was developed and implemented. 

f A plan for program self-study was developed. 



Performance Appraisal and Status Distributions 

The North Carolina Career Development Program (CDP) Pilot has, as its goal, 
the attraction and retention of "the best people" to education. That goal can be 
reached if individual performance is, at least in part, a factor in determining 
the mix of job tasks a given individual is asked to perform and in determining the 
individual's rate of pay. The problem, then, is to implement a system of perform- 
ance evaluation that allows system administrators to make valid and reliable 
judgments about the quality of one's performance. 

The 16 CDP units now have two years* experience in implementing the performance 
appraisal system that is, technically at least, the base for making both salary and 
job assignment decisions. This report will summarize and analyze the progress of 
the units in moving toward the goal of implementing a valid and reliable evaluation. 
Of equal importance however is the equity of such a system. That, then, is another 
dimension on which implementation can be studied. 



In order to generate the data on which these analyses rest, two separate 
procedures were used. First, staff of the Division of Personnel Relations conduct- 
ed a telephone survey of CDP coordinators in each of the 15 units* to determine how 
many state-paid employees in each unit had attained Career Status II. It should be 
remembered that, in order to earn Career Status II, an employee must have been 
tenured for three years and must have earned evaluation ratings that indicate 
performance was above standard, well above standard' and/or superior in each 
function. 

Second, each CDP coordinator provided DPI with a roster of al2 unit employees, 
indicating actual evaluation results, along with information about career status, 
school assignment, and evaluation instrument used. These evaluation records were 
then analysed by DPI staff. 

Table 1 indicates the results of the first procedure. About 2,728 educators 
have been awarded Career Status II. This represents about 81 percent of all 
applicants for Career Status II, and about 6 percent of all certificated employees 
in the pilot units. 
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Unit 

Alexander 270 

Buncombe 1035 

Burke 703 

Burlington 330 

Edenton-Chowan 152 

Tarboro 164 

Greene 172 

Roanoke Rapids 153 

Harnett 634 

Haywood 487 

Montgomery 240 

New Hanover 1034 

Orange 254 

Perquimans 108 

Salisbury 140 



TABLE 1 

Di-.tribution by Unit of State-Paid Persons Applying for 
and Receiving Level II Designation 

Total Employe es Applied for # Level II % Level II 



119 
739 
305 
186 
88 
90 
117 
S2 
372 
228 
131 
550 
163 
47 
92 



98 
608 
256 
142 
72 
69 
103 
69 
316 
181 
115 
452 
132 
28 
79 



36% 
59% 
36% 
43% 
47% 
42% 
60% 
45% 
50% 
37% 
48% 
44% 
57% 
24% 
56% 
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Again, It should be noted that Table I reflects only those educators who are 
state-paid, and Includes teachers, principals, and central office staff. 

Table 2 shows the distribution of all staff— state-, locally-, or federally-paid— to 
the current levels of the Career Development Plan. Generally, Initially-certified 
persons and those in provisional status, average about 19 percent of each unit. 
Greene County, with only 7 percent of its staff in this category, is clearly well 
below this average, while Tarboro, with 30 percent, is well above. Career Level I 
employees make up between 23 percent and 63 percent of the staff at each unit, with 
a state-wide average of 35 percent. Career Status II was awarded to about 42 
percent of .ill unit employees, with a range from a low of 22 percent (Perquimans) 
to a high of 58 percent (Greene). Non-participants make up about 4 percent of the 
state-wide total, with 9 of the 15 units having between 99 percent and 100 percent 
participation. See Table 2. 



TABLE 2 

Distribution of All Staff by Levels 

June, 1987 



in CDP Units 



ICP & Prov 



Level I 



Level II 



Non-Part. 



Total 



Alexander 50 (17%) 

Burke 134 (17%) 

Burlington 70 (17%) 

Buncombe 306 (22%) 

Chowan 30 (19%) 

Greene 14 (7%) 

Harnett 154 (23%) 

Haywood 70 (13%) 

Montgomery 66 (25%) 

New Hanover 180 (15%) 

Orange 71 (23%) 

Perquimans 16 (14%) 
Roanoke Rapids 52 (28%) 

SallsDury 31 (18%) 

Tarboro 56 (30%) 



116 (40%) 
353 (45%) 
191 (46%) 
311 (23%) 
57 (36%) 
66 (35%) 
206 (31%) 
246 (47%) 
75 (29%) 
431 (36%) 
108 (35%) 
71 (61% 
53 (29%) 
(33%) 
jc (28%) 



99 (34%) 
266 (34%' 
151 (36%) 
672 (49%) 
72 (45%) 
109 (58%) 
320 (47%) 
190 (36%) 
120 (46%) 
485 (41%) 
122 (40%) 
28 (24%) 
77 (42%) 
86 (49%) 
74 (40%) 



26 (9%) 

26 (3%) 
5 (1%) 

71 (5%) 
0 (0%) 
0 (0%) 
0 (0%) 

17 (3%) 
0 (0%) 

92 (7%) 
7 (2%) 

1 (<1%) 

1 (<1%) 

1 «1%) 

2 (<1%) 



291 
779 
417 

1360 
159 
189 
680 
523 
261 

1188 
308 
116 
183 
175 
184 



TOTAL 



1300 (19%) 



2393 (35%) 



2871 (42%) 



249 (4%) 



6813 
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This description of distributions, thus, indicates how staff have been 
evaluated and reflects both participation rates and proportions of staff meeting 
the tenure and experience ratings. It is important to remember that, for the 
Pilot, a fast-track was established to allow participants to advance to Career 
Status II, even though they had not met the statutory requirement of three years 
at Career Status I. 

Since September 1985, the school units participating in the Career 
Development Program pilot study have conducted performance appraisal in a more 
objective, rigorous, and meaningful fashion than ever before. By definition, 
raters (primarily, but not exclusively, principals) have had to develop new 
skills in observation and evaluation, and to develop increased knowledge both 
about instruction and about the specific criteria used in the North Carolina 
Teacher Performance Appraisal System. To assume either that all raters would 
acquire these skills and knowledge in a uniform time frame or that they would 
acquire them to a uniformly similar degree is to ignore everything we know 
about skills development. 

Moreover, this new evaluation system is being installed in very different 
contexts. Some units hed established procedures for conducting in-class 
observations, for implementing clinical supervision models, and for treating 
evaluation in a positive, rather than punitive way long before the CDP was 
launched. Other units had not done any or all of those things. Certainly the 
tradition of teacher performance appraisal throughout the United States has 
been that evaluation is either done in a perfunctory fashion ("What does It 
matter? Nothing will happen regardless of ratings."), or is perceived by 
raters as an opportunity to give a psychological reward as a motivator ("Since 
I cannot give anyone a real money reward, I'll give everyone a psychological 
stroke by^giviTi^a high rating"). What is being attempted in North Carolina 
is to reverse this tradition by installing an objective, classroom-based, 
research-supported evaluation system. 

o 8 
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Not surprisingly, the performance of evaluators in the leal units improves 
over time. Changes in modal ratings show this. If we compare ratings in 85-86 
and 86-87 we can see change. 

Table 3 gives us a very gross picture of change in ratings at the modal 
level between 1985-86 and 1986-87. Basically, change was in one of three 
directions: up, down, and mixed. Thirteen uf fifteen units experienced 
changed modes (the mode is the rating given most frequently), while two— 
Harnett and Burke— were unchanged. Interestingly both of these systems had 
modes of 4 in every function. Two units— Perquimans and Montgomery- 
experienced a reduction in the modes in 1987. The change was most dramatic in 
Perquimans where the mode fell from 5 to 4 on seven of eight functions. In 
Montgomery, the modes fell from 6 tr 5 on five functions. Three units— Greene, 
New Hanover, and Orange Counties— experienced mixed results, with functional 
modes In one case going up; in another, down. All other units experienced 
increased modes in at least one function when 1987 results are compared with 
those in 1985-86. Table 4 presents these change data for all units. 



TABLE 3: MODAL CHANGE 1985-1987 
BY FUNCTIONS 



UP 



DOWN 



UNCHANGED 



Chowan 

Perquimans 

Greene 

New Hanover 

Roanoke Rapids 

Tarboro 

Harnett 

Montgomery 

Burlington 

Orange 

Salisbury 

Alexander 

Burke 

Haywood 

Buncombe 



2,8 

8 



1,5-6,8 

7 

6 

2.5,8 



4.8 



3-8 

1-3,6-8 



7.8 

2 



2.3-5,8 



2-7 
2-8 
3,5 
6 



1-3,5 



9 



1-8 



1-8 
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TABLE A 

COMPARISON Of KODAL SCORES, 1985-86 to 1936-C7 



^s^iinctlon 




















Unit 


Year 


1 


2 


3 


4 


5 


6 


7 


t 


Chowan 


87 


5 


5 


5 


5 


5 


5 


5 


b 




86 


5 


5 


5 


4/5 






5 


5 


Perqulmens 


87 


4 


4 




4 


4 


4 


4 


4 




86 


4 




5 




4/5 




5 


5 


Greene 


87 


5 


5 


4 




4 


5 


e 


e 




86 


5 


5 


5 








5 


5 


New Hanover 


87 


4 


5 


4 


4 


4 




5 


4 




86 


4 


4 


4 








5 


4 


Roanoke Rapids 


87 


5 


5 


5 






5 


5 


5 


86 


5 


5 


4 








4 


3 


Tarboro 


87 


4 


S 


4 


4 


4 


4 


5 


4 




86 


3 


3 


3 








3 


3 


Harnett 


87 


4 


4 


4 


4 


4 


4 


4 


4 




86 


4 


4 


4 








4 


4 


Montgomery 


8) 


5 


'-"'l'-' 


& 




"5'"' 


""I 


5 


-'I 




86 


6 


6 


6 








5 


6 


Burlington 


87 


5 


5 


5 


4 


5 


5 


5 


' 5 




86 


4 


5 


5 








5 


4 


Orange 


87 


4 


4 


4 


4 


4 


4 


5 


< 




86 


S 


5 


S 








4 


4 


Salisbury 


87 


5 


5 


5 






5 


5 


5 




86 


5 


5 


5 








5 


5 


Alexander 


87 


4 


4 


4 


4 






4 ' 


£ 




86 


4 


3 


4 










3 


Burke 


87 


4 


4 


4 








4 


4 




tc 


< 


< 


4 








4 


4 


Key weed 


87 


4/5 


4 


5 








4 


5 




86 


4 


4 


5 








4 


4 


Buncciribe 


87 


5 




5 




5 




5 


6 




86 


5 




5 




b 


• 

1 


5 


5 



*Mo(lr1 ratings not equivalent to Career Status II. 
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It should be noted that 1n only four units--Perqu1mans, Harnett, Alexander, and 
Burke— did the mode fail to rise to a rating equivalent to that required for 
Career Status II. Put another way, in eleven units, the most commonly chosen 
ratings, if extended across cases, would put most educators at Career Status 
II. Last year this was true in ten units. Partly, the data in Table 13 
illustrate an interesting dynamic in performance appraisal. Simultaneously, ^ 
the skills and knowledge of evaluators are improving and the skills of teachers 
are improving. In some cases, this miqht explain lower ratings in 1987 (evalua- 
tors improved faster than teachers) or higher ratings in 1987 (teachers improved 
faster than evaluators). In reality, the true case probably lies some where 
between these two extremes. 

Finally, it would be helpful to understand the imDact of the evaluation 
data we have been discussing. Up to this point, we have not been able to 
(ixamine the variety of combinations, earned by individuals, that these 
aggregations permit. Table 2 showed the distribution of staff to various 
career status levels. These assignments represent a combination of experience 
and performance requirements. What would the career status distributions look 
like if we considered only performance ratings? Table 5 presents information 
that answers this question. To derive this information, we examined all 
evaluation reports for the 6300 individuals, without respect to actual career 
status. We Ihen aggregated all cases into one of three categories: those 
whose performance ratings were the required combination of 4 and 5 or 6; 
those whose ratings included a 3 or 4 but not 5's or 6's; those whose ratings 
included a 1 or 2. 
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TABLE 5 

DISTRIBUTION OF TEACHERS BY RATING EQUIVALENT *BY UNIT 





CS II 


Equivalent 


CS I Equivalent 


Substandard 


Total 


Unit 








K 




% 


N 


Chowan. 


109 


74% 


01 


elk 


1 


Da 


147 


Peiquimans 


48 


49% 


HO 




1 0 


1 9<v 


107 


Greene 


143 


84% 






c 


11 


170 


New Hanover 


684 


60% 






37 


31 


1139 


Roanoke Rapids 


106 


64% 


49 


301 


10 


61 


165 


Tarboro 


107 


58% 


wO 


311 




111 


183 


Harnett 


407 


65% 




3?1 


IR 


9X 

C M 


623 


Montgomery 


197 


83% 


32 


13% 


9 


4% 


238 


Burlington 


241 


65% 


118 


32% 


12 


3% 


371 


Orange 


214 


69% 


lb 


25% 


18 


6% 


308 


Salisbury 


129 


80% 


27 


17% 


6 


4% 


162 


Alexandet 


145 


52% 


128 


46% 


6 


2% 


279 


Burke 


394 


55% 


295 


41% 


22 


3% 


711 


Haywood 


327 


69% 


138 


29% 


11 


2% 


476 


Buriroinbe 


958 


78% 


240 


20% 


24 


2% 


1222 


folal 


4209 


67% 


1880 


30% 


212 


3% 


6301 



* A "rating equivalent" shows evaluation results of better than 
above standard* at standard* or substandard. It should not 
be confused with Career Sta i designations. Projections based on 
these figures assume no personnel change; no performance change* 
and no other significant differences. 
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statewide, we see that 67 percent of cases met the performance criteria 
required for ai' ^ancement to Career Status II, while 30 percent were equivalent 
to Career Status I, ^nd 3 percent ware sub- standard. Essentially, we can 
conservative ly t .e that of the 6300 cases, virtually all will meet the 
time and performance requirements needed to be awarded Career Status I by the 
end of the pilot period. That is, a first-year teacher wh.se results are 
reported here will meet the requirements of G.S. 115C-325 by the end of 
school -year 1988-89, will be awarded tenure, and Career Status I. 

Moreover, any teacher in this set who has completed his first year of 
tenured employment during 1985-86 will be eligible to be designated 
Career Status II by the end of the pilot program. If we then estimate the 
percentages who will be serving at Career Status II, it must be approaching 70 
percent of all teachers. The difficulty, however, is the differences among 
systems. While 49 percent of teachers in Perquimans County earned Career 
Status 1 1 -equivalent ratings during 1986-87, 84 percent of Greene County's 
teachers did. 

Figure 1 plots these inter-system differences and illustrates the 
differences between actual Career Status II teachers (thin line) and Career 
Status Il-cquivalents (thick line.) Notice that the two lines are virtually 
parallel. This fact suggest that raters within units treated teachers 
consistently; they were not biased by knowing that some teachers were actually 
Career Status II candidates. 

The second important fact illustrated by this figure is the wide variation 
among systems. 0-^. the available information, we are unab'e to explain these 
variations among systems. This may, however, indicate that raters across 
systems are not reliable. That is, a common understanding of the criteria and 
their value does not exist state-wide. 
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Finally, this figure suggests that, by and large, any rater errors have 
been in a positive direction, not a negative one. That is, it may be true 
that some teachers who did not deserve Career Status II were awarded it, but 
probably no teacher who did deserve it was denied it. Nevertheless, if the 
performance appraisal is to be fair and objective, our efforts must be hent to 
eliminating errors, regardless of their impact. 

This issue of rater error leads naturally to a discussion of the appeals 
procedure. The General Assembly requires that, in the Career Development 
Pilot, an appeal be built in to protect teachers who feel that their rating<; 
were unfair. The State Steering Committee developed a procedure ^or this 
process and the State Board of Education adopted it. The process has two 
phases: appeal to a peer review panel and appeal to the local board of 
education. Tables 6 and 7 illustrate the appeals arising this year. Table 
15 shows that a total of three appeals of decision to withhold Career Status 
I were brought across all units. In all three cases the peer review panel 
sustained the principal's recommendation and the appellant did not bring the 
matter to the local board. 

Table 7 provides information on Career Status II appeals. A total of 62 
appeals (about 1 percent of all participants) were taken to the peer review 
panels. In 50 cases, the panel upheld the principal's decision, while in 8 
the panel held for the appellant. In all, 24 cases were brought to the local 
board. Local board actions have not been completed and there is insufficient 
data to project what their decisions might be. 

The net effect of chese data is t^at very few appeals are brought and of 
those that are, peer review panels tend to uphold the principals. This 
reinforces our earlier observation that, even though rater errors may occur, 
they tend not to be errors that exclude people who deserve advancement to 
Career Status II. 
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TABLE 6 
CDP APPEALS 
CAREER STATUS I 



County 


Appeal 


Reccmme tided 


To Board 


Board Decision 


Alexander 


0 








Burke 


1 


1 Yes 


0 




Burlington 


1 


1 Yes 


0 




Buncombe 


0 






m M 


ChoWan 


0 








Greene 


0 








Harnett 


u 




m m 




Naywood 


1 


I Yes 


0 




Montgomery 


0 








New Hanover 


0 








Orange 


0 








Perquimans 


0 








Roanoke Rapids 


0 








Salisbury 


0 


m m 






Tarboro 


0 








TOTAL 


3 


3 


0 
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TABLE 7 
COP APPEALS 
CAREER STATUS 11 



County 
Alf xender 
Burke 

Burlington 
Punc o'nbe 

Chcwen 
Greene 
Harnett 
Haywood 

Montgomery 
New Hanover 



Orange 

Terquimons 
Rofincle Rapids 
Sri iibury 
Tarboro 



Appeal 
0 
11 

0 
12 

1 
3 
1 
6 

0 

22 



TOTAL 
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1 

0 
0 
3 



62 



Uphold Principal 
Reconv-nended To Board 



8 Yes 
3 No 



10 Yes 

2 No 

1 No 

3 Yes 
1 Yes 
6 Yes 



19 Yes 
3 No 



1 Yes 
1 No 

1 Yes 



Board Decision 



3 Award 
3 Deny 



0 
0 
0 
2 



11 



1 to the board 
0 



1 Status 
increase 

2 Remand 
principal , 
but no 

status award 



5Q Yes 
10 No 
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24 



17 



Not yet 
determined 



2 Deny 
9/14 



2 Deny 

1 Award; others 
to be heard 



The appeals procedure has been subjected to study by a sub-committee of 
the State Steering Committee of the Career Development Plan. After studying 
the experiences of 15 of the participating units, the sub-cooittee 
recommended that the state f^ide procedure be continued as it was in 1986-87. 
Appendix A summarizes the findings of the appeals process study. 

Pilot Program Self Study 

The participating units recognize the G.S.115C-363 contains a member of 
implicit and explicit goals and objectives. In order to assure attnetion to 
each of these, the units have developed a procedure for Self-Study during the 
progress of the pilot. This study was begun during the current school year 
and, therefore, unit data are being compiled now. The data set, however, is 
contained in Appendix B anc permits the reader to review the legislative goals 
and see what data will be collected to document progress towards the 
achievement of these goals. 

Monitoring Charlotte-Mecklenburg CDP 

In the Fall of 1987, the CMS requested assistance in evaluating the 
locally developed Cereer Development program. Six persons who are familiar 
with the General Assembly's program visted with teachers, administrators, 
students, and parents in Charlotte-Mecklenburg. Wide-spread dissatisfaction 
with the program was expressed. Specifically, comments concerned: 

• the rating of individual lessons, 

• the lack of feedback after observation; 

• the heavy requirements of Professional Development Plans 
I the burden of extensive required staff development; and 

• the documentation system of observations. 

er|c ^® 
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After consultation with executives of CMS, numerous changes in the system 
were proposed. These changes have the effect of br-irging the implementation 
design much more into line with the state sponsored program in the other 15 
units. 

Simultaneously officials of North Carolina Department of Public 
Instruction developed a plan to monitor the implementation of Career 
Development In Charlotte-Mecklenburg Schools. A copy of the plan may be found 
in Appendix C. 
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APPENDIX A 




PUBLIC INSTRUCTION 



NORTH CAROUKA 
DEPARThlENTOF 



• 116 West Edeoton Street •Education Building 
Rilcigll • 27603-1712 

■ 

January lit 1988 
HEKORANDUM 

TO: Robert D. Boyd 



Director, Persdilfnel Relations 
RE: Career Development Appeals Procedure 



As you know, the legislation that authorizes the Career Development Program 
requires that a procedure be established to allow employees an avenue for " 
bringing appeals against decisions not to promote. During the first year of 
the pilot program, the 16 districts decided to grant widest possible local 
autonomy In establishing such procedures. As a result of their experience, 
however, the units, through the GDP State Steering Committee, established a 
study group whose charge was to develop a uniform appeals procedure for 
adoption by the State Board of Education. 

Beginning In September 1986, the sub-connlttee met regularly with attorneys 
from the North Carolina Attorney General's Office, an attorney retained by 
NCAE, and representatives of NCSBA, as well as with staf{ of this division. 
The result was the appeals procedure that was presented to, and adopted by, 
the State Board of Education In April 1987. At that time, Ks. Turnage 
requested that Implementation of the appeals procedure be studied and the 
results reported to the Board. 

Helen LeGette, Burlington City Schools, chaired the study group whose results 
are appended. Attachment 1 summarizes training offered to both the appeals 
panels and to local boards of education. With the exception of Orange County, 
all boards that received appeals also received some trainina or orientation to 
enable members to participate in the appeals hearing. Similarly, all panel 
members received some training, if an appeal was brought. 

Attachments 2 and 3 summarize Information about appeals at both the panel and 
local board levels. It should be noted that a total of 65 appeals were 
brought to the panels, representing about 1 percent of all evaluation cases 
(N«6300), and 24 were brought'to the local board. In most cases, at both 
levels, the original decision was upheld. 



Assistant State Superintendent 



FROM: 



David Holdzkom 
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Robert 0. Boyd 
Page 2 

January 11, 1988 



The final attachn»ent sets out problems and recomnendatlons Identified by each 
unit. Basically, four units reconrnended asking people from outside the 
district to hear appeals, while 12 units urged that either no procedural 
change be made, declined to specify improvements, or supported the plan as 
established. 

Based on this information, the sub-committee recommended to the Steering 
Committee that no changes in the procedure be. made but that additional 
training be offered to board menbers and others with responsibility for 
conducting Appeals. To that end, the NCSUA has already conducted a 4-hour 
training program on appeal procedures for members of local boards. 

I trust that this information will be helpful to members of the State Board of 
Education. If additional Information is required, please let me know. 

DH/ah 

Attachments 
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APPEALS PROCEDURE 
TRAINING 



LEA 


Panel 


Board 


Alexander 


None 


None 


Buncombe 


Two-hour training packet, plus 
further guidelines and procedures 
given to those involved. 


Offered NCPAT but no takers. 
CDP coordinator and Board 
attorney explained process to 
LBE. 


Burke 


David Holdzkom trained those who 
were available. (Some on vaca- 
tion.) KCAE protested LEA's 
efforts to train. Said this was 
effort to prejudice panel mem- 
bers against teachers. 


One-hour training session 
(discussion) on two different 
occasion?. Training offered 
but LBE members unable to fit 
into their schedules. 


Burlington 


Assist. superintendent, personnel 
coordinator, and CDP coordinator 
met with panel members to go over 
procedures, responsibilities of 
panel, etc. 


None 


Charlotte 


None 


One evenir g session on CD 

•ogram and one hour prior to 
appeals . 


Edenton 


Three-hour training package for 
all trained in NCPAT . (Modified 
Roanoi^^ Rapids plan.) 


None 


Fort Bragg 


NCPAT required. 

22 


None 

1 





LEA 


Panel 


Page 

Board 


2 of 2 






Greene Co. 


Coordinator met with panel at 
least five days before the 
hearing to review the law and 
procedures. 


None 




• 




Haywood Co. 


Training on process, procedure, 
and other material in training 
package . 






• 




Montgomery 


None 


None 








New Hanover 


Training package (purpose, 
responsibilities, procedure, 
etc.) 


Same as panel 








Orange Co. 


Two-hours training with super- 
intendent on procedures, stand- 
ards, and order for appeals 
hearing 


None 








Perquimans 


Training package 


None 








Roanoke Rapids 


Three-hour workshop 


None 








Salisbury 


Planned as needed 


Planned if needed 








Tarboro 


Special training session with 
David Holdzkom 


Training (1985-86) by 
Holdzkom 


David 


- 




Harnett 


Detailed written directions pro- 
vided to all panel members, 
principal, and teacher prior to 
panel meeting. 


None 
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CAREER DEVELOPMENT 


PLAN 






19 86- 19 87 






Reasons 


Second Parties Present 


Results 




• 

School Sygtea 


Total # 
Appeals 


K/Z 


Proc. 


Both 


Spouse 


Colleague 


Attorney 


Org. 
Rep. 


Other 


Upheld 


Not 
Upheld 


Still 
Pending 


Alexander Co. 


0 
























Buncombe Co. 


4 












1 


2 


1 




1 


3 


Burke Co. 


6 










2 


3 


2 




3 


3 




Burlington 


0 
























Charlotte 




3 


1 


9 


2 


3 


4 


1 




9 


4 


1 


Edenton-Chowan 


0 
























Fort Bragg 


0 
























Greene Co. 


0 
























Harnett Co. 


0 
























llay%#ood Co. 


2 














2 




2 






Montgomery Co. 


0 
























New Hanover 


11 












11 






6 


5 




Orange Co. 


1 


















1 






Perquimans 


0 
























Roanoke Rapids 


0 
























Salisbury 


0 
























Tarboro 


0 
























TOTALS 




1> 


/ 


1 




3" 


n 


> 


1 


u 


|3 


V 



CAREER DEVELOPMENT PLAN 
APPEALS P/NEL REVIEWS 



, *One panel unable to reach consensus 

^ 26 





Total 1 
Appeals 


Reasons 


Second Parties Present 


1 Results 


A/r 


rroc • 


oocn 


Spouse 


Colleague 


Attorney 


Org. 
Rep. 


Other 


Upneld 


1 Not 
Upheld 


Appealed 
To Board 


B Alexander Co. 


0 
























B Buncoiibe Co. 


12 


10 


1 

X 


1 

X 






' 


o 




IL 


Z 




I Burke Co.* 


12 


Q 


1 

X 




X 






o 




o 
O 


•J 


o 


Burlington 


1 






1 
1 












1 






Charlotte* 
' Hecklenburg 


N/A 


















rv 

9 






Edenton-Chowan 


1 




















1 




Ft. Bragg 


0 
























flreene Co. 


_3 


3 












z 










Harnett Co. 


1 


1 
















1 
1 






Hayiiood Co. 


7 


3 






1 


1 

X 









7 







Montgomery Co. 


0 






















Hanover 


22 


12 


4 






7 








JL 7 


J 


IJL 


Orange Co. 


2 


2 
















1 

X 


1 

X 


1 

X 


Perquif^ians 


1 






1 












1 

X 






Roanoce Rapidf; 0 
























Salisbury 


0 
























Tarboro 


3 


1 








1 




3 






3 




fOTAlS 






1 

CO 




2 


'1 i 




0 




/3 


A3 
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CAIEER DEVELOPMENT PLAN 
APPEALS PROCEDURE 



yaOOL STSTEM 



PROBLEHS /SOLOTIONS 



REOOHNENDATIONS 



Rincoiribe 



Burk4 



Burlington 



1. Put tlM lloiit on presentations. 
7. Have not found solution for training of Board 
MMbers. 



Problen: Having 36t of personnel trained in NCPAT 
and therefore eligible for appeals panels. Teachers 
chose friends, principals chose other principals, 
etc. Solution: Now removing from roster names of 
those who have served on panels. Can*t serve again 
for 2 ye^rs. 



None. Process worked vrell. 
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1. Have trained cadre to cross county lines. 

2. Let that decision be final (note that salary 
increase is not a property right. Therefore, 
it is not necessary to involve the LEE.) 



1. Agree with Burke County proposal: Outside 
review before going to LBE. 

2. State Board (School Boards Association) adopt 
LBE appeals process with fairly standard pro* 
cedures and guidelines for LBE (in terms of 
process we have developed for statewide use.) 



Have outside panels who are trained to read FODAs ^ 
and make decisions. 



Keep appeals procedures within LEA boundaries. 
Provide training for Board members on CDP, 
performance appraisal and purposes of appeals 
panel revliiw. 
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CAREER DEVELOPMENT PLAN 
APPEALS PROCEDURE 



tOMOL SYSTEM 



Charlotte 



Edenton-Chowan 



Port Braqg 



Graane Co. 



Harnett Co. 



Ha^iwood Cq^ 



ERIC 



PROBLEMS /SOLUTIONS 



Logistics : Scheduling 



None. Satisfield with process. 



None 



iinor problems: 

1. Need for definition of arbitrary /capricious 
in the law. 

2. LBE felt reasons for recommendations not 
specific enough to justify panels decisions. 



None 



No major problems except time involved and 
anxiety. 
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RECOMMENDATIONS 



Keep as is. 



None 



1. Include definition of arbitrary and capricious 
in the law. 

2. Develop training packet for panel members and 
LBE. 

3. Be more specific as to who/how panel members 
are selected. 



"The state plan is acceptable in its present form. 
He do not feel that an outside review panel is 
necessary or advisable 



(None listed.) 
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CAREER DEVELOPMENT PLAN 
APPEAIS PROCEDURE 



1986 - 1987 



SCHOOL 8T8TEM 



HontgoMry 



New Hanover 



Orange Co. 



Perquimans Co. 



Roanoke Rapids 



ERIC 
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PROBLEMS/SOLUTIONS 



(None listed*) 



1. Definition of proper procedures and inference 
that career status should be awarded by **default* 
if proper" procedures were not followed. 

2. Lack of specificity of panel report and lack of 
direction as to how LBE should handle • 

3. Limited knowledge of process by panel members 
that no amount of **special training" overcomes. 



1. Apparent lack of understanding/experience of 
panel members In dealing with procedures so as 
to retain total objectivity. 

2. Lack of underst^ iding of scope of responsibility 
of panel met. >ers. 



RECOMMENDATIONS 



**We have had no appeals.... Therefore, it is 
difficult to address the issue. Basically I 
think the current policy is workable.*" 



(El Clark reserved reconunendations for meeting of 
Appeals Subcommittee.) 



(None listed.) 



In 1985-86, our major problem was at the Board level. 
The Board had no policy and no training. 



1. Use outside-of -district person for first 
(initial) panel review. 

2. Establish/develop more cxtonsivr requirements 
for panel service to include Career Status II 
persons only. 

3. Provide training for LBE members. 



(None listed.} 



Strength (in Roanoke Rapids): training for panel 
members and the message they take back to their 
colleagues. "Our decisions are always consensus 
and that makes it hard to overturn an appeal.^ 
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CAREER DEVELOPMENT PLAN 
APPEALS PROCEDURE 



I'M" ^£2 



SCaOOt StSTEM 



Salisbury 



Tarboro 
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PB0BIJEMS/SOL0TI0H5 



(None listed.) 



Acting principal had not folloi^ed procedure of 
giving teachers (2) the appeals procedure and the 
appeals form within required time. 



RECOHMENDATIONS 



(No information.) 



Plan is workable as written. 
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Bijrlington City Schools 



1712 Vaughn Road 
Burlington, North Carolina 27215 
919-226-1151 



Terrtll Duncan 



Chtlrmtn 



Joseph R. Sinclair 
Superintendent 



KEMORAKDUN 
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TO? 



Members of the State Steering Committee 



FROM; 



Helen R, LeGette, Chairman of Appeals Subcommittee 



DATE: 



November 30, 1987 



c 



RE: 



Recommendations Regarding Appeals Process 



The Appeals Subcommittee met in Raleigh on November 24. Attending the 
meeting were: El Clark, John Dunn, Ann Edwards, Jeanette Davis, David 
Holdzkom, Laura Crumpler, Jan Holem-<:rotts, and Helen LeGette. 

In preparation for the meeting, we surveyed the sixteen pilots and Fort 
Bragg to gather information regarding local units* experiences with the 
appeals process, training provided to appeals panels and board members, 
and recommendations related to the procedure* Responses indicated that 
the majority of the school systems either made no recommendations for 
changing the procedure or recommended that the procedure be left as it 
now exists* Most of the concerns dealt with training needs of panel 
members or (particularly) board menibers* 

The Appeals Subcommittee discussed the responses from the pilot units 
and agreed that it would be inappropriate to alter the process state- 
wide to address problems occurring in a few units. Laura Crumpler also 
stated that the number of problems encountered was actually very small 
in light of the appeals procedure *s being used for the first time last 
year* (Typically, more problems occur during the initial year of imple* 
mentation of any new procedure than in subsequent years.) 

It was suggested that State Department of Public Instruction personnel 
collaborate with the staff of the North Carolina School Boards Associ- 
ation (NCSBA) in providing training and/or human resources to local 
boards. Also, subcomn^ittee members agreed that it would be helpful if 
SDPI personnel* career development coordinators, and other local personnel 
having responsibilities related to the appeals procedure attend the NCSBA 
seminar on tha appeals process on Decendber 16. (The seminar, which will 
be held at the North Raleigh Hilton, is designed to acquaint local board 
members with the appeals process and their roles and responsibilities re- 
lated to that process.) 
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Recommendations Regarding Appeals Process 
Page 2 

Nov«inber 30, 1987 



It was further agreed thti-. a resource guide including definitions, 
possible operating procedures, roles of panel members and board mem- 
bers, and possible courses of action for local boards would be helpful 
to the pilot school systems. Committee members felt that such a re- 
source should be a joint effort of SDPI, NCSBA, and the attorney gen- 
eral's office. ^ 

David Holdzkom asked that a report on the subcommittee's recommendation 
be made at the January ireeting of the State Steering Committee. He also 
stated that the subcommittee's findings and recommendations will be shared 
with the State Board of Education in February. 
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APPENDIX B 



CAREER DEVELOPMENT PLAN EVALUATION SUBCOMMinEE 
The evaluation subconnlttee has reviewed the CDP legislation and 
Identified long term program goals and short term Implementation goals sst cjt 
, In the legislation. 

PROGRAM GOALS FROM LEGISLATION (LONG TERM, GENERAL) 
.1.. It Is essential to attract and retain the best people In 
teaching/school administration. 

2. It Is the policy of the State of North Carolina to provide 

an adequate base salary for and to encourage differentiation of all 
teachers and school administrators. 

3. This pilot progrmn shall remain In operation through the 1988-1989 
school year so as to enable the State Board and the General Assembly 
to analyze all facets of a career development plan prior to statewide 
Implementation. 

4. It Is the Intent of the General Assembly that this pilot program act 
as a means of developing a career ladder plan that could be 
Implemented on a statewide basis In the future. 

5. The plan shall be designed to Improve the quality of classroom 
Instruction. 

6. The plan shall be designed to Increase the attractiveness of 
teaching. 

7. The plan shall be designed to ercourage the recognition and 
retention of high quality teachers. 

IMPLEMENTATION GOALS FROM THE LEGISLATION (SPECIFIC) 
1. The plan shall be based on cont1nuous» comprehensive evaluation of 
teacher perfonaance Indicated by nultlple sources of Information. 
■.H" 2. Evaluation shall be based on indicators associated with effective 

classroom practices. 
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3. The plan shall Include at the appropriate time personnel policies 
that will result In an appropriate number of employees being placed 
In each level of differentiation In each local school administrative 
unit. 

4. The plan shall specify a process for administration, periodic 
review, and evaluation. 

5. The criteria and procedures for advancement under the plan shall be 
made public, and Instruction shall be provided for teachers about 
these criteria and procedures prior to the Implementation of the 
process. 

6. The plan shall provide for a teacher to move to a lower level either 
by Individual choice or based on unacceptable performance review. 

7. The plan shall contain an appeal process that provides prompt and 
Impartial review. 

8. The plan shall be designed to give an employee Increasing 
responsibility, recognition and pay as the employee gains experience 
and professional ability. 

9. The plan shall provide for annual methods of evaluation using 
practicing educators, opportunities to correct deficiencies, and 
dismissal of employees who after an^le opportunities cannot or will 
not perform. 

10. The plan for acfanlnlstrators shall be designed to give each employee 
clear opportunities for advancement, recognition and Increased pay If 
the employee demonstrates high effectiveness In the position. 
Including superintendent, associate superintendent or assistant 
superintendent. 

-2. 
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n. Levels of differentiation shall be based on the employee's 
initiative and desire to increase the employee's professional 
abilities and the employee's success In doing so. 

12. The plan for administrators shall include methods tuil instruments of 
evaluation that will determine what level of performance and effort 
and what accomplishments warrant different salary classifications, 
and at what point dismissal or reassignment of an administrator is 
warranted. 

13. The local board of education in each local unit shall select and 
train at least one observer/evaluator for each ninety-six (96) 
employees to be evaluated. 

14. The State Board shall set standards for observer/evaluators. 

15. These observer/evaluators shall work with principals to carry out 
the provisions of this act. 

16. Provisions for participation shall: 

a. allow individuals employed prior to Implementation to 
participate in the plan or continue under the system of 
employment In effect prior to Implementation, and 

b. allow employees who opt to participate the opportunity to 
opt out ot the plan at any time; however, an employee 
may opt out only once during the pilot. 

17. The State Board shall report annually to the President of the 
Senate, the Speaker of the House of Representatives and those 
connittees named In the legislation on the continuing development 
anu implementation of the Career Development Plan. 
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APPENDIX C 



Plan for Monitoring Charlott e-Mecklenburg Career Development Plan 

G. S. 115C-363.8 states that .. the State Board shall monitor the 
Charlotte-Mecklenburg plan. In order to Implement this mandate the 
following plan Is proposed: 

1. Section 206(b) of House Bill 151A states that the Joint Legislation 
Commission on Governmental operations shall conduct an evaluation of the 
School Career Development Pilot Program in the 15 pilot units and the 
Charlotte-Mecklenburg school system. The evaluation shall be designed to 
study the impact of the School Career Development Program on: 

1. Improved teacher performance 

2. employee retention and recruitment 

3. employee satisfaction 

A. overall school improvement 

5. enhanced learning environment 

6. student attitudes towards school 

7. community support of the program 

The results of this evaluation will become a part of the monitoring and 
evaluation of the Charlotte-Mecklenburg program. 

2. A plan for the statewide evaluation of the Career Development Program has 
been approved by the State Board, of Education. This plan will address 
the following questions as set out in the legislation. 

a. what is the evidence that there is condnuous and comprehensive 
evaluation of performance? 

b. what is the evidence of development of plans that will result in an 
appropriate number of employees being place in each level of 
differentiation? 

c. what is the evidence that the Career Development Plan specifies a 
process for administration, periodic review, and evaluation. 

d. what is the eviden e that the criteria and procedures for 
advancement under the plan have been provided for teachers tbout 
these criteria and procedures? 

e. what is the evidence that the plan provides for a teacher to move to 
a lower level either by Individual choice or by an unacceptable 
performance review? 

f. what is the evidence that the plan contains an appeal process that 
provides prompt and impartial review? 

g. what is the evidence that the plan is designed to give an employee 
increasing responsibility, recognition, and pay as the employee 
gains experience and professional ability, with levels of 
differentiation based on the employees success in increasing 
professional abilities? 
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includes inithodJ*Md iIl«ruIl!i^/%' ''^f" "dministrators that 
What level of PerfoL;cr«reffo%t"n%'"i'r ""^ <>««^'ne 
warrant different salary classlfJcI^ accoaplishmenta 

J. What is the evidence tJat the locat^-^^^ dismissal 
and trained observer/evaluatorslJr elrl nt ^'"'f"?" "^^'^^ 
to be evaluated and that the State BoJrS J^^^y-**'' <96) employees 

^ observer/evaluators? standards for 

to" :::;t"rp:o^'L\^:i^1j:^^^^^^^^ -rRed „ith principal 

Program legislation? Carolina Career Development 

I. what is the evidence ck«». ..w 

Quantitative data will k» . i 

lnt.r-r.t.r relLbUit, 'PP'oprLeel, de.li„g ^it^. 



3. 
4. 



b. «jra.pay for extra duties 

defining level 1 
d, •^^-.j — J 



reviewing requirements for level II 

^^a^^^«^/'Se^^^rrTX'a^es':u^'ot^ °' '»'%o«'"-er rde in 

e. conte.,t - how the Charlotfe/MecUeihurJ ^''"^"/evaluators. 

f . administrators - o«e/Mecklenburg process deals with content 

g. team involvement - consensus decisions 
Should ve do anything with ,.udent outcomes? 



b. 
c. 
d. 
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